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Abstract 

An approximation formula is derived for acceptance rates of nonlocal 
Metropolis updates in simulations of lattice field theories. The predic- 
tions of the formula agree quite well with Monte Carlo simulations of 
2-dimensional Sine Gordon, XY and 0^ models. The results are consis- 
tent with the following rule: For a critical model with a fundamental 
Hamiltonian 7i(0) sufficiently high acceptance rates for a complete elim- 
ination of critical slowing down can only be expected if the expansion 
of + in terms of the shift contains no relevant term (mass 

term) . 



Monte Carlo simulations of critical or nearly critical statistical mechanical systems 
with local algorithms suffer from critical slowing down. Roughly speaking, the 
autocorrelation time in the Markov chain scales like r ~ where ^ denotes the 
correlation length, and z is the dynamical critical exponent. For local algorithms, 
z PS 2. To overcome this problem, various nonlocal Monte Carlo algorithms have 
been developed. 

Cluster algorithms are successful in overcoming critical slowing down for a large 
class of models. The alternative is multigrid Monte Carlo 0, 0] • In this letter, every 
algorithm that updates stochastic variables on a hierarchy of length scales is called 
multigrid Monte Carlo algorithm. There are models where no successful cluster 
algorithms have been found whereas multigrid Monte Carlo works |Q. Multigrid 
Monte Carlo is a candidate for noncritical simulations of nonabelian lattice gauge 
theory 

Presently, the only generally applicable method to study algorithms for interacting 
models is numerical experiment. It is however important to have some theoretical 
understanding that helps to predict which algorithms will have a chance to overcome 
critical slowing down in simulations of a given model. As a contribution to the 
research in this direction we present a study of the kinematics of multigrid Monte 
Carlo algorithms. Sufficiently high acceptance rates are considered as necessary for 
successful multigrid Monte Carlo procedures. In this letter, we derive and discuss 
an approximation formula for the scale (block size) dependence of acceptance rates 
for nonlocal Metropolis updates. 

We consider models with partition functions 

z = \ n ^M-nm (1) 

on cubic dimensional lattices Aq. We shall use dimensionless spin variables. Non- 
local Monte Carlo updates are defined as follows: Consider the fundamental lattice 
Aq as divided in cubic blocks of size l"^. This defines a block lattice Ai. By iterating 
this procedure one obtains a whole hierarchy of block lattices Aq, Ai, . . . , Kk- Let us 
denote block lattice points in A^ by x' . Block spins are defined on block lattices 
Afc. They are averages of the fundamental field over blocks of side length Lb = l^'- 

= Lt'^" L-/ Y: ■ (2) 

The L B-dependent factor in front of the average comes from the fact that the corre- 
sponding dimensionful block spins are measured in units of the block lattice spacing. 
A nonlocal change of the configuration consists of a shift 

(px ^ 4>x + Sipx, (3) 

L-/ Y.^^ = ■ (4) 

s is a real parameter. Note that ^x' + s for x' = x'^, and remains unchanged 

on the other blocks. The simplest choice of the "coarse-to-fine interpolation kernel" 
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ip that obeys the constraint (Q) is a piecewise constant kernel: ipx = L^b '^^^'^ ^ if 
x G Xg, and else. Other kernels are smooth and thus avoid large energy costs from 
the block boundaries. A systematic study of different kernels will be reported on 
elsewhere [|]. 

The s-dependent Metropolis acceptance rate for such proposals is given by 

= (min[l, exp(-A7i:)]) , (5) 

where 

ATi: = n{<\) + si)) - n{(j)) . (6) 

fl{s) has an integral representation 

n{s) = Jdu min(l, e"") J ^ e''^'" (e^^^^) . (7) 

Assuming that the probability distribution of ATi. is approximately Gaussian, we 
are led to 

(e^f^^) = e^^if-'^^p' [1 + o{p^)] , (8) 

with hi = {AH) and /la = " (AHf). Then the integrations in (0) can be 

done exactly: 



nis) ^ i ( erfc(^) + e'^-'^^erfcl^^^) ) , (9) 



with erfc(a;) = dt exp(— t ). Using invariance properties of the measure T)(f) 

one can show that the difference of hi and /i2 is of order s"^. We shall see below that 
the approximation hi ^ /i2 is very good. In this case the acceptance rate prediction 
simplifies further, 

n{s) ^ erfc(iyt) . (10) 

(For an analog result in the context of hybrid Monte Carlo see 0.) For free massless 
field theory with action 7i(0) = ^{(j), —A(j)), we obtain the exact result 

fi(.)=erfc(y||s|), (11) 

with a = — Alp). Note that in this case hi = h2 = ^as^. In d dimensions one 
finds [| 

a = 2dLB for piecewise constant kernels, 
a — > const for smooth kernels . 

Lb»1 

As a consequence, in massless free field theory, to maintain a constant acceptance 
rate (of, say, 50 percent) the changes s have to be scaled down like for piecewise 
constant kernels, whereas for smooth kernels the acceptance rates do not depend on 
the block size. At least for free field theory, the disadvantage of the piecewise 
constant kernels can be compensated for by using a W-cycle instead of a V-cycle. 
Smooth kernels can be used only in V-cycle algorithms. 
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In the following we shall apply formula (^) in the discussion of multigrid procedures 
for three different spin models in two dimensions: the Sine Gordon model, the XY 
model, and the single-component 0^ theory. 

The 2-dimensional Sine Gordon model is defined by the Hamiltonian 

n<t>) = ^(0, -A0) - CE . (12) 

The model undergoes a (Kosterlitz-Thouless) phase transition at P^, and Pc Svr 
for ( ^ 0. For f3 > /3c, the flow of the effective Hamiltonian (in the sense of the 
block spin renormalization group) converges to that of a massless free field theory. 
The long distance behavior of the theory is therefore that of a Gaussian model. One 
might naively conclude that multigrid should be the right method to fight critical 
slowing down in the simulation of the Sine Gordon model in the massless phase. 
But this is not so. For hi we find the expression 

h = —s' + (CY.[l-cos{sij,)], (13) 

with C = (cos (px)- The essential point is that the second term in ([13D is proportional 
to the block volume for piecewise constant and for smooth kernels. One therefore 
has to face a dramatic decrease of acceptance when the blocks become large, even 
for small fugacity (. A constant acceptance rate is achieved only when the proposed 
steps are scaled down like L^^. It is therefore unlikely that any multigrid algorithm 
- based on nonlocal updates of the type discussed in this letter - will be successful 
for this model. We demonstrate the validity of formula (0) (using a Monte Carlo 
estimate for C) by comparing with Monte Carlo results at /? = 39.478 and C = 1- 
This point is in the massless phase. In figure 1 we show both the numerical and 
analytical results for ^l{s) for = 4, 8, 16, 32 on lattices of size 16^, 32^, 64^, 128^, 
respectively. 

We now discuss the 2-dimensional XY model, defined by the partition function 

Z= [VQ expifS E cos(e, - 6,)) . (14) 

<x,y> 

As the Sine Gordon model, the XY model has a massless (spin wave) and a massive 
phase. Nonlocal updates are defined by Qx ^ + sifjx, with ip obeying again 
the normalization condition (p. Note that such an update changes the block spin 
(defined as the block average of the spins in the unit vector representation) by an 
amount ~ s only when the spins inside the block are sufficiently aligned. This will 
be the case in the spin wave phase for large enough 13. hi is given by 

hi = PE Y.[l- cos{s{^x - ^,))] , (15) 

<x,y> 

with E = {cos{Qx — 'dy)), X and y nearest neighbors. For piecewise constant kernels, 
hi is proportional to Lb- For smooth kernels hi will become independent of for 
large enough blocks. For small s, 

hi ^ \s^(5E E (V'x - ^yf = \s^f3Ea . (16) 

<x,y> 
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As above, a = [ip, —Aip). This quantity becomes nearly independent of Lb already 
for Lb larger than 16 From the point of view of acceptance rates the XY 
model therefore behaves like massless free field theory. In fact, a dynamical critical 
exponent z consistent with zero was observed in the massless phase ^j. The failure 
of multigrid Monte Carlo in the massive phase {z ~ 1.4 for piecewise constant 
kernels [H) is an example for the fact that good acceptance rates are not sufficient 
to overcome critical slowing down. 

We again checked the accuracy of formula (0) by comparing with Monte Carlo 
results at /3 = 1.2 (which is in the spin wave phase). The only numerical input for 
the analytical formula was the link expectation value E. The results are displayed 
in figure 2. One can do a similar discussion for the 0{N) nonlinear a-model with 
N > 2, leading to the same prediction for the scale dependence of the acceptance 
rates. This behavior was already observed in multigrid Monte Carlo simulations 
of the 2-dimensional 0(3) nonlinear cr-model with smooth and piecewise constant 
kernels 

Let us finally turn to single-component (i-dimensional 0^ theory, defined by the 
action 



For h-i one finds 



hi = s'[kc^+[^ + ^P]T.^l]+s'^T.i^t, (18) 

where P = (0^). We have used that expectation values of operators which are odd 
in vanish on finite lattices. Because of the normalization condition (^, J2x'^x 
increases with L^, independent of d, whereas J2x 4't scales like L'^'^, for smooth and 
for piecewise constant kernels. Therefore also in this model we have to face rapidly 
decreasing acceptance rates when the blocks become large. As in the case of the Sine 
Gordon model, s is to be rescaled like Lb^ in order to maintain constant acceptance 
rates. (Note that this discussion is only of relevance when the correlation length ^ 
is larger than the block size Lb- The essential point is that the acceptance rates 
should not become too small before Lb is of the order of ^.) From our point of 
view therefore there is little hope that multigrid algorithms of the type considered 
in this letter can overcome critical slowing down in the 1-component 0^ model. In 
numerical simulations of 2-dimensional 0^ theory, a dynamical critical behavior is 
found that is consistent with z ^ 2 for piecewise constant and for smooth kernels 



T0| , [Tl| . In four dimensions, there is no definite estimate for z . 

Figure 3 shows a comparison of Monte Carlo results for 2-dimensional 0^ theory with 
the theoretical prediction based on the numerical evaluation of P. The simulations 
were done in the symmetric phase at = —0.56 and Aq = 2.4. The correlation 
length at this point is ,^ ~ 15 [jrT] . 



In this letter, we have presented a simple yet accurate formula that expresses accep- 
tance rates for nonlocal update algorithms in terms of one single parameter (entering 
hi), which is easy to compute, e.g. by Monte Carlo simulations on a small lattice. 
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We encountered two classes of models. For Sine Gordon and 0^ theory s had to be 
rescaled like for piecewise constant and for smooth kernels, whereas for the XY 
model and the 0{N) nonlinear cr-model one can achieve L^-independent acceptance 
rates (choosing smooth kernels). 

The results are consistent with the following rule: Sufficiently high acceptance rates 
for a complete elimination of critical slowing down can only be expected if hi = 
{!-[{(/) + sip) — 7i(0)) contains no relevant operator in tp. The (superficial) degree r of 
relevance of a local operator is defined by r = d + m{2 — d)/2 — n. m is the number of 
fields, and n counts the derivatives. An operator is called relevant if r > 0. A mass 
term always has r = 2, and a 0^-term has r = 4 — d. A kinetic term a = {ip, —Atp) 
has r = 0. The above statement is formulated for smooth kernels. For piecewise 
constant some modifications are necessary. The main difference is that a oc L for 
piecewise constant kernels. 

With the help of the rule stated above it is possible to decide whether a given 
statistical model is a natural candidate for multigrid Monte Carlo or not. We believe 
that our formula can be useful to study different choices of interpolation kernels ip 
in multigrid Monte Carlo for nonabelian gauge theories 
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Figure Captions 



FIG.l. fl{s) in the 2- dimensional Sine Gordon model, /3 = 39.478, C = 1- From top 
to bottom: Lb = 4, 8, 16, 32 on a 16^, 32^, 64^, 128^ lattice, respectively. Points with 
error bars: Monte Carlo results, hnes: analytical results. 

FIG. 2. Q{s) in the 2-dimensional XY model, /3 = 1.2. From top to bottom: Lb = 
4,8,16 on a 16^,32^,64^ lattice, respectively. Points with error bars: Monte Carlo 
results, lines: analytical results. 

FIG. 3. Q{s) in the 2-dimensional 0*^ theory, = —0.56, Aq = 2.4. From top to 
bottom: = 4, 8, 16 on a 16^, 32^, 64^ lattice, respectively. Points with error bars: 
Monte Carlo results, lines: analytical results. 
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